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Abstract 


This paper continues a systematic and comprehensive study on the structural properties of CFL 
functions, which are in general multi-valued partial functions computed by one-way one-head nondeter¬ 
ministic pushdown automata equipped with write-only output tapes (or pushdown transducers), where 
CFL refers to a relevance to context-free languages. The CFL functions tend to behave quite differently 


from their corresponding context-free languages. We extensively discuss containments, separations, and 
refinements among various classes of functions obtained from the CFL functions by applying Boolean 
operations, functional composition, many-one relativization, and Turing relativization. In particular, 
Turing relativization helps construct a hierarchy over the class of CFL functions. We also analyze the 
computational complexity of optimization functions, which are to find optimal values of CFL functions, 
and discuss their relationships to the associated languages. 

Keywords: multi-valued partial function, oracle. Boolean operation, refinement, many-one relativiza¬ 
tion, Turing relativization, CFL hierarchy, optimization, pushdown automaton, context-free language 


1 Much Ado about Functions 

In a traditional field of formal languages and automata, we have dealt primarily with languages because of 
their practical applications to, for example, a parsing analysis of programming languages. Most fundamental 
languages listed in many undergraduate textbooks are, unarguably, regular (or rational) languages and 
context-free (or algebraic) languages. 

Opposed to the recognition of languages, translation of words, for example, requires a mechanism of 
transforming input words to output words. Aho et al. [T] studied machines that produce words on output 
tapes while reading symbols on an input tape. Mappings on strings (or word relations) that are realized by 
such machines are known as transductions. Since languages are regarded, from an integrated viewpoint, as 
Boolean-valued (i.e., {0, l}-valued) total functions, it seems more essential to study the behaviors of those 
functions. This task is, however, quite challenging, because these functions often demand quite different 
concepts, technical tools, and proof arguments, compared to those for languages. When underlying machines 
are particularly nondeterministic, they may produce numerous distinct output values (including the case of 
no output values). Mappings realized by such machines become, in general, multi-valued partial functions 
transforming each admissible string to a certain finite (possibly empty) set of strings. 

Based on a model of polynomial-time nondeterministic Turing machine, computational complexity theory 
has long discussed the structural complexity of various NP function classes, including NPMV, NPSV, and 
NPSVt (where MV and SV respectively stand for “multi-valued” and “single-valued” and the subscript “t” 
does for “total”). See, e.g., a survey [H] . 

Within a scope of formal languages and automata, there is also rich literature concerning the behaviors of 
nondeterministic finite automata equipped with write-only output tapes (known as rational transducers) and 
properties of associated multi-valued partial functions (known also as rational transductions). Significant 
efforts have been made over the years to understand the functionality of such functions. A well-known field 
of functions include “CFL functions,” which were formally discussed in 1963 by Evey [1] and Fisher [5] and 
general properties have been since then discussed in, e.g., [3 HU]. CFL functions are generally computed by 
one-way one-head nondeterministic pushdown automata (or npda’s, in short) equipped with write-only output 
tapes. For example, the function PALsub{w) = {x € {0,1}* | 3u,v [w = uxv],x = for every w G {0,1}* 
is a CFL function, where x^ is x in reverse. As subclasses of CFL functions, three fundamental function 
classes CFLMV, CFLSV, and CFLSVt were recognized explicitly in [TU] and further explored in [UU] . 

In recent literature, fascinating structural properties of CFL functions have been extensively investigated. 
Konstantinidis et al. [10] took an algebraic approach toward the characterization of CFL functions. In relation 
to cryptography, it was shown that there exists a pseudorandom generator in CFLSVt that “fools” every 

*This extended abstract has already appeared in the Proceedings of the 15th Italian Conference of Theoretical Computer 
Science (ICTCS 2014), September 17—19, Perugia, Italy, CEUR Workshop Proceedings, vol.1231, pp.225—236, 2014. 
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language in a non-uniform (or an advised) version of REG [19]. Another function class CFLMV(2) in |2^ 
contains pseudorandom generators against a non-uniform analogue of CFL. The behaviors of functions in 
those function classes seem to look quite different from what we have known for context-free languages. 
For instance, the single-valued total function class CFLSV can be seen as a functional extension of the 
language family CFL n co-CFL rather than CFL m- In stark contrast with a tidy theory of NP functions, 
circumstances that surround CFL functions differ significantly because of mechanical constraints (e.g., a 
use of stacks, one-way moves of tape heads, and A-moves) that harness the behaviors of underlying npda’s 
with output tapes. One such example is concerning a notion of refinement |13] (or uniformization [ini). 
Unlike language families, a containment between two multi-valued partial functions is customarily replaced 
by refinement. Konstantinidis et al. nni posed a basic question of whether every function in CFLMV has 
a refinement in CFLSV. This question was lately solved negatively [22] and this result clearly contrasts a 
situation that a similar relationship is not known to hold between NPMV and NPSV. 

Amazingly, there still remains a vast range of structural properties that await for further investigation. 
Thus, we wish to continue a coherent and systematic study on the structural behaviors of the aforementioned 
CFL functions. This paper aims at exploring fundamental relationships (such as, containment, separation, 
and refinement) among the above function classes and their natural extensions via four typical operations: (i) 
Boolean operations, (ii) functional composition, (iii) many-one relativization, and (iv) Turing relativization. 
The last two operations are a natural generalization of many-one and Turing CFL-reducibilities among 
languages m- We use the Turing relativization to introduce a hierarchy of function classes 
nCFLMV, and E^FLsv for each level k > 1, in which the first E-level classes coincide with CFLMV and 
CFLSV, respectively. We show that all functions in this hierarchy have linear space-complexity. With regard 
to refinement, we show that, if the CFL hierarchy of [21] collapses to the /cth level, every function in E^^LMV 
has a refinement in E^^Lgy Jqj. every index k >2. 

Every nondeterministic machine with an output tape can be naturally seen as a process of generating 
a set of feasible “solutions” of each instance. Among those solutions, it is useful to study the complexity 
of finding “optimal” solutions. This gives rise to optimization functions. Earlier, Krentel m discussed 
properties of OptP that is composed of polynomial-time optimization functions. Here, we are focused on 
similar functions induced by npda’s with output tapes. We denote by OptCFL a class of those optimization 
CFL functions. This function class is proven to be located between CFLSVt and EjF^SVt. Moreover, we 
show the class separation between CFLSVt and OptCFL. 

To see a role of functions during a process of recognizing languages, Kobler and Thierauf [5] introduced 
a H-advice operator by generalizing the Karp-Lipton /-advice operator, and they argued the computational 
complexity of languages in P//J- and NP//J^ induced by any given function class T. Likewise, we discuss the 
complexity of REG//J^ and CFL/ZJ” when T are various subclasses of CFL functions, particularly CFLSVt 
and OptCFL. 

All omitted or abridged proofs, because of the page limit, will appear shortly in a complete version of 
this paper. 


2 A Starting Point 

Formal Languages. Let N be the set of all natural numbers (i.e., nonnegative integers) and set N+ = 
N — {0}. Throughout this paper, we use the term “ polynomial” to mean polynomials on N with nonnegative 
coefficients. In particular, a linear polynomial is of the form ax -\- b with a,b G N. The notation A — B for 
two sets A and B indicates the set difference {x \ x G A,x ^ B}. Given any set A, 'P(A) denotes the power 
set of A. A set E^ (resp., E-^), where k G N, consists only of strings of length k (resp., at most k). Here, 
we set E* = E^. The empty string is always denoted A. Given any language A over E, its complement 

is E* — A, which is also denoted by A as long as E is clear from the context. 

We adopt a track notation [ y] from m- For two symbols tr and r, [ f] expresses a new symbol. For 
two strings x = xiX 2 ■ ■ • Xn and y = yiy 2 ■ • - yn of length n, [ y] denotes a string [ yj;][ [ yll]- Whenever 

7^ Ij/I) '"^0 follow a convention introduced in [15]: if |a;| < \y\, then [y] actually means [], where 
m = \y \ — I a: I and # is a designated new symbol. Similarly, when |a;| > |j/|, the notation [y] expresses [y#™] 
with m = \x\ — \y\. 

As our basic computation model, we use one-way one-head nondeterministic pushdown automata (or 
npda’s, in short) allowing A-moves (or A-transitions) of their input-tape heads. The notations REG and 
CFL stand for the families of all regular languages and of all context-free languages, respectively. For 
each number k G N"*", the k-conjunctive closure of CFL, denoted by CFL(A:), is defined to be {Ct. Ai I 
Ai,A 2 , ...,AkG CFL} (see, e.g., [H]). 
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Given any language A (used as an oracle), CFL;^ (or CFLt(^)) expresses a collection of all languages 
recognized by npda’s equipped with write-only query tapes with which the npda’s make non-adaptive oracle 
queries to A, provided that all computation paths of the npda’s must terminate in 0(n) steps no matter 
what oracle is used [H]. We use the notation CFLy (or CFLt(C)) for language family C to denote the union 
UagC CFLy. Its deterministic version is expressed as DCFL^. The CFL hierarchy | k € 

N+} is composed of classes ^ dCFL, = cFL, = co-E^fl^ a^fl = DCFLT(npF)^ 

E^fl = CFLT(nCFL) for each index k>\^. 

Functions and Refinement. Our terminology associated with multi-valued partial functions closely fol¬ 
lows the standard terminology in computational complexity theory. Throughout this paper, we adopt the 
following convention: the generic term “function” always refers to “multi-valued partial function,” provided 
that single-valued functions are viewed as a special case of multi-valued functions and, moreover, partial 
functions include total functions. We are interested in multi-valued partial functions mapping E* to 7^(r*) 
for certain alphabets E and F. When / is single-valued, we often write f{x) = y instead of y € f{x)- 
Associated with /, dom(/) denotes the domain of /, defined to be {a; S E* | f{x) ^ 0}. If a: ^ dom(a;), 
then f{x) is said to be undefined. The range ran(/) of / is a set {y G F* | f~^{y) ^ 0}. 

For any language A, the characteristic function for A, denoted by xa, is a function defined as xa{x) = I 
if a; G A and xa{x) = 0 otherwise. We also use a quasi-characteristic function rjA, which is defined as 
rjA^x) = 1 for any string a: in A and rjAix) is not defined for all the other strings x. 

Concerning all function classes discussed in this paper, it is natural to concentrate only on functions 
whose outcomes are bounded in size by fixed polynomials. More precisely, a multi-valued partial function 
/ : E* —>■ ViT*) is called polynomially bounded (resp., linearly bounded) if there exists a polynomial (resp., 
a linear polynomial) p such that, for any two strings x G dom(/) and y G F*, if y G f{x) then \y\ < p(|a:|) 
holds. In this paper, we understand that all function classes are made of polynomially-bounded functions. 
Given two alphabets E and F, a function / : E* —>■ 7^(F*) is called length preserving if, for any a; G E* and 
y G F*, y G f{x) implies |a:| = |y|. 

Whenever we refer to a write-only tape, we always assume that (i) initially, all cells of the tape are blank, 
(ii) a tape head starts at the so-called start cell, (iii) the tape head steps forward whenever it writes down 
any non-blank symbol, and (iv) the tape head can stay still only in a blank cell. An output (outcome or 
output string) along a computation path is a string produced on the output tape after the computation 
path is terminated. We call an output string valid (or legitimate) if it is produced along a certain accepting 
computation path. 

To describe npda’s, we take the following specific definition. For any given function / : E* — VfT*), an 
npda N equipped with a one-way read-only input tape and a write-only output tape that computes / must 
have the form (Q, E, {((;, $}, 0, F, S, go, Zq, Qacc, Qrej), where Q is a set of inner states, 0 is a stack alphabet, 
<70 (G Q) is the initial state, Zq (g 0) is the stack’s bottom marker, and S : {Q — Qhait) x (E U {A}) x 0 —)• 
ViQ X 0* X (F U {A})) is a transition function, where Qhait = Qacc U Qrej, S = E U {();, $}, and ij; and $ are 
respectively left and right endmarkers. It is important to note that, in accordance with the basic setting 
of |21] . we consider only npda’s whose computation paths are all terminate (i.e., reach halting states) in 
0(n) stepsH where n refers to input size. We refer to this specific condition regarding execution time as the 
termination condition. 

A function class CFLMV is composed of all (multi-valued partial) functions /, each of which maps E* 
to 7^(F*) for certain alphabets E and F and there exists an npda N with a one-way read-only input tape 
and a write-only output tape such that, for every input a; G E*, f(x) is a set of all valid outcomes of 
N on the input x. The termination condition imposed on our npda’s obviously leads to an anticipated 
containment CFLMV C NPMV. Another class CFLSV is a subclass of CFLMV consisting of single-valued 
partial functions. In addition, CFLMVt and CFLSVt are respectively restrictions of CFLMV and CFLSV 
onto total functions. Those function classes were discussed earlier in HU. 

An important concept associated with multi-valued partial functions is refinement |13j . This concept 
(denoted by Ere/) is more suitable to use than set containment (C). Given two multi-valued partial functions 
/ and g, we say that / is a refinement of g, denoted by g Ere/ f, if (1) dom(/) = dom(y) and (2) for every 
X, f{x) C g(x) (as a set inclusion). We also say that g is refined by /. Given two sets T and G of functions, 
G Qref ^ if every function g m. G can be refined by a certain function / in J-. When / is additionally 
single-valued, we call / a single-valued refinement of g. 

tTo describe a multi-valued partial function /, the expression “f : E* —^ F*” is customarily used in the literature. However, 
the current expression “/ : S* —t VIT*)” matches a fact that the outcome of / on each input string in S* is a subset of F*. 

Af no execution time bound is imposed, a function computed by an npda that nondeterministically produces every binary 
string on its output tape for each input becomes a valid CFL function; however, this function is no longer an NP function. 
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3 Basic Operations for Function Classes 

Let us discuss our theme of the structural complexity of various classes of (multi-valued partial) functions 
by exploring fundamental relationships among those function classes. In the course of our discussion, we 
will unearth an exquisite nature of CFL functions, which looks quite different from that of NP functions. 

We begin with demonstrating basic features of CFL functions. First, let us present close relationships 
between CFL functions and context-free languages. Notice that, for any function / in CFLMV, both dom(/) 
and ran(/) belong to CFL. It is useful to recall from [21] a notion of [^-extension. Assuming that ^ S, 
a '^-extension of a given string a; G S* is a string x over E U {l^} satisfying the following requirement: x is 
obtained directly from x simply by removing all occurrences of t] in x. For example, if a: = 01101, then x may 
be Oltjll^Ol or t]0110t]t]l. The next lemma resembles Nivat’s representation theorem for rational transductions 
(see, e.g., [ini Theorem 2]). 

Lemma 3.1 For any function f G CFLMV, there exist a language A G CFL and a linear polynomial p such 
that, for every pair x and y, y G f{x) iff (i) [|] G A, (ii) |?/| < p(|a;|), and (Hi) |i| = |y| for certain strings 
X and y, which are \\-extensions of x and y, respectively. 

An immediate application of Lemma Id. II leads to a functional version of the well-known pumping lemma 

0 - 

Lemma 3.2 (functional pumping lemma for CFLMV) Let E and F be any two alphabets and let / : E* ^ 
V{T*) he any function in CFLMV. There exist three numbers m G N"*" and c, d G N that satisfy the following 
condition. Any string w G E* with |a(;| > m and any string s G f(w) are decomposed into w = uvxyz and 
s = abpqr such that (i) \vxy\ < m, (ii) \vyhq\ > 1, (Hi) \bq\ < cm + d, and (iv) aVpq''r G f{uv''xy''z) for 
any number a G N. In the case where f is further length preserving, the following condition also holds: (v) 
|n| = |6| and \y\ = Igj. Moreover, (i)-(ii) can be replaced by (i’) \bq\ > 1. 

Boolean operations over languages in CFL have been extensively discussed in the past literature (e.g., 
[mu])- Similarly, it is possible to consider Boolean operations that are directly applicable to functions. In 
particular, we are focused on three typical Boolean operations: union, intersection, and complement. Let us 
define the first two operations. Given two function classes Fi and T 2 , let IFi A T 2 (resp., T\ V JFf) denote 
a class of all functions / defined as f{x) = f\{x) Cl f^ix) (set intersection) (resp., f{x) = fi{x) U f 2 {x), set 
union) over all inputs x, where /i G Ti_ and /2 G Expanding CFLMV(2) in Section [H we inductively 
dehne a k-conjunctive function class CFLMV(A:) as follows: CFLMV(l) = CFLMV and CFLMV(A: -I- 1) = 
CFLMV(A:) A CFLMV for any index k G N"*". Likewise, CFLSV(fc) is defined using CFLSV instead of 
CFLMV. 

Proposition 3.3 Let k,m>l. 

1. CFLMV(max{A:,m}) C CFLMV(fc) V CFLMV(to) C CFLMV(fcm). 

CFLMV(max{A:,m}) C CFLMV(fc) A CFLMV(to) C CFLMV(fc -h m). 

3. CFLSV(A:) C CFLSV(/c -f 1). 

Note that Proposition 13.31 31 follows indirectly from a result in [12] . 

Fenner et al. |S] considered “complements” of NP functions. Likewise, we can discuss complements of 
CFL functions. Let T be any family of functions whose output sizes are upper-bounded by certain linear 
polynomials. A function / is in co-J- if there are a linear polynomial p, another function g € F, and a 
constant no G N such that, for any pair {x, y) with |a:| > no, y G f{x) iff both \y\ < p(|a;|) and y ^ g{x) holds. 
This condition implies that f{x) = — ^(a;) (set difference) for all x G E-"“. The finite portion E<”° 

of inputs is ignored. 

The use of set difference in the above dehnition makes us introduce another class operator ©. Given 
two sets F, Q of functions, FqQ denotes a collection of functions h satisfying the following: for certain two 
functions f € F and g G G, h{x) = f{x) — g{x) (set difference) holds for any x. 

In Proposition 13.41 we will give basic properties of functions in co-CFLMV and of the operator ©. To 
describe the proposition, we need to introduce a new function class, denoted by NFAMV, which is defined in 
a similar way of introducing GFLMV using, in place of npda’s, one-way (one-head) nondeterministic finite 
automata (or nfa’s, in short) with write-only output tapes, provided that the termination condition (i.e., all 
computation paths terminate in linear time) must hold. 

Proposition 3.4 1. co-(co-CFLMV) = CFLMV. 

co-GFLMV = NFAMV © CFLMV. 
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3. CFLMV 0 CFLMV = CFLMV A co-CFLMV. 

4 . CFLMV 7 ^ co-CFLMV. The same holds for CFLMV*. 

Proof Sketch. We will show only (2). (0) Let / G NFAMV 0 CFLMV and take two functions h G 
NFAMV and g G CFLMV for which f{x) = h{x) — g{x) (set difference) for all inputs x G S*. Choose 
a linear polynomial p satisfying that, for every pair (x,y), y G h(x) U g{x) implies |j/| < p(|a;|). By the 
definition of /, it holds that f{x) = — {g{x) U — h{x))) for all x. For simplicity, we define 

r{x) = g{x) U — h{x)) for every x. It thus holds that f{x) = — r{x). It is not difficult to 

show that r is in CFLMV. 

(C) Let / G co-CFLMV. There are a linear polynomial p and a function g G CFLMV satisfying that 
f{x) = — g{x) for all x. We set h(x) = Since h G NFAMV, we conclude that / belongs to 

NFAMV 0 CFLMV. □ 

Another basic operation used for functions is functional composition. The functional composition fog 
of two functions / and g is defined as (/ o g){x) = Uy 6 g(x) fiv) every input x. For two function classes 

T and Q,\etiFoQ = {fog\f£T,gG Q}. In particular, we inductively define CFLSV^^^ = CFLSV and 
CFLSV*-^^^^ = CFLSV o CFLSV*-^^ for each index fc > 1. For instance, the function f{x) = {xx} defined for 
any x G E* belongs to CFLSV^^^ This fact yields, e.g., CFLSV(2) C CFLSV^"^^ Unlike NP function classes 
(such as, NPSV and NPMV), CFLSV* (and therefore CFLSV and CFLMV) is not closed under functional 
composition. 

Proposition 3.5 CFLSV* ^ CFLSV*^^^ (Also for CFLSV and CFLMV.j 

Proof Sketch. Let E = {0,1, \\} be our alphabet and define fdup\iix) = {xt]x} for any input x G {0,1}* 
and fdup\i{x) = {A} for any other inputs x. It is not difficult to show that fdupii S CFLSV*To show that 
fdup\i ^ CFLSV*, we assume that fdupit S CFLSV*. Let DUP\^ be a “marked” version of DUP (duplication), 
defined as DUP\^ = {xt]x | x G {0,1}*}. It holds that, for every w ^ X, w G ran{fdup\i) iff there is a string 
X such that w G fdupt\{x) iff w G DUP\^. Thus, DUP\^ U {A} = ran(/d„p^). Note that DUP\^ G CFL since 
fdup\i G CFLSV*. However, it is well-known that DUP\^ ^ CFL. This leads to a contradiction. Therefore, 
we conclude that fdup\i ^ CFLSV*. □ 

To examine the role of functions in a process of recognizing a given language, a // -advice operator, defined 
by Kobler and Thierauf [5], is quite useful. Given a class T of functions, a language L is in CFL//J^ if there 
exists a language B G CFL and a function h G P satisfying L = {x \ 3y G h{x) s.t. [y] G B}. Analogously, 
REG//J^ is defined using REG instead of CEL. This operator naturally extends a /-advice operator of 

[lain]. 

In the polynomial-time setting, it holds that NP n co-NP = P//NPSV* [S]. A similar equality, however, 
does not hold for CFL functions. 

Proposition 3.6 1. REG//NFASV* ^ CFL and CFL ^ REG//NFAMV. 

2. REG//NFASV* is closed under complement but REG//NFAMV is not. 

3. CFL n co-CFL C REG//CFLSV*. 

Proof Sketch. (1) Note that the language DUP^ = {x#x | x G {0,1}*} (duplication) falls into 
REG//NFASV* by setting h{xf(y) = y and B = {[f] | x G {0,1}*}. The key idea is the following claim. (*) 
A language L is in REG//NFAMV iff L is recognized by a certain one-way two-head (non-sensing) nfa (or 
an nfa(2), in short) with A-moves. See a survey, e.g., [7], for this model. Now, consider Lpai = {x#x^ | x G 
{0,1}*} (palindromes). Since Lpai cannot be recognized by any nfa(2), it follows that Lpai ^ REG//NFAMV. 

(2) The non-closure property of REG//NFAMV follows from a fact that the class of languages recognized 
by nfa(2)’s is not closed under complement. Use the above claim (*) to obtain the desired result. □ 

Bwfore closing this section, we exhibit a simple structural difference between languages and functions. 
It is well-known that all languages over the unary alphabet {1} in CFL belong to REG. On the contrary, 
there is a function / : {!}* —)• {0,1}* such that / is in CFLMV but not in NFAMV. 

4 Oracle Computation and Two Relativizations 

Oracle computation is a natural extension of ordinary stand-alone computation by providing external in¬ 
formation by way of query-and-answer communication. Such oracle computation can realize various forms 
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of relativizations, including many-one and Turing relativizations and thus introduce relativized languages 
and functions. By analogy with relativized NP functions (e.g., M), let us consider many-one and Turing 
relativizations of CFL functions. The first notion of many-one relativization was discussed for languages in 
automata theory 0111] and we intend to extend it to CFL functions. Given any language A over alphabet F, 
a function / : E* —> P(F*) is in CFLMV^ (or CFLMVm(^)) if there exists an npda M with two write-only 
tapes (one of which is a standard output tape and the other is a query tape) such that, for any x G T,*, 
(i) along any accepting computation path p oi M on x (notationally, p G ACCm(x)), M produces a query 
string pp on the query tape as well as an output string Zp on the output tape and (ii) f{x) equals the set 
{Zp \ Pp G A,p G ACCm{x)}. Such an M is referred to as an oracle npda. Given any language family C, we 
further set CFLMV(^ (or CFLMVm(C)) to be UaeC CFLMV(^. Similarly, we define CFLSV(^ and CFLSV(^ 
by additionally demanding the size of each output string set is at most 1. Using CFLSV(^, a relativized 
language family CFL(^ defined in [21] can be expressed as CFL(^ = {L \ rjL G CFLSVJ^}. 

Lemma 4 .I 1. CFLMV|^®° = CFLMV and CFLSV]^^° = CFLSV. 

2 . CFLSV('=+^> = CFLSV^’^^('=^. 

Proposition 4.2 1. REG//CFLSVt C CFL^^^^^) ^ 

2. CFL//CFLSVt C 

Proof Sketch. We will prove only (2). For convenience, we write [x,y]'^ for [y] in this proof. Let 
CFL;^[i] = CFL;^ and = CFL„(CFL;^[fe]) for every index k > 1 Let L G CFL//CFLSVt 

and take an npda M and a function h G CFLSVt for which L = {x \ M accepts \x, /i(x)]^ }. Let M' be 
an npda with an output tape computing h. An oracle npda N is also defined as follows. On input x, N 
simulates M' on x and nondeterministically produces [x,yY query tape when M' outputs y, where 

X and y are appropriate tj-extensions of x and y, respectively. An oracle A receives a tj-extension \x,yY 
and decides whether M accepts [x,yY' by removing all l^s. Glearly, L belongs to GFL(^ via N. Define 
another npda Ni. On input w = [i,y]^, A^i simulates M on [x,zY' by guessing z symbol by symbol. At 
the same time, it writes on a query tape and accepts w exactly when M enters an accepting state. 

Let B = {[y'.zY' \ y = z}. Note that B is in GFL^^^. Hence, A is in GFL^ C GFL^IJj, and thus L is in 
GFL^IJ]. Since GFL^^Jj = GFL®^^^^^ |5T], the desired conclusion follows. □ 

The second relativization is Turing relativization. A multi-valued partial function / belongs to GFLMV^ 
(or GFLMVt(A)) if there exists an oracle npda M having three extra inner states {qquery,qyes,qno] that 
satisfies the following three conditions: on each input x, (i) if M enters a query state Qquery, then a valid 
string, say, s written on the query tape is sent to A and, automatically, the content of the query tape becomes 
blank and the tape head returns to the start cell, (ii) oracle A sets M’s inner state to qyes if s G A and 
qno otherwise, and (iii) all computation paths of M terminate in time 0(n) no matter what oracle is used. 
Obviously, GFLMVy = GFLMVy holds for any oracle A. Define GFLMV^ (or GFLMVt(C)) to be the 
union IJyiec CFLMVy for a given language family C. 

Analogously to the well-known NPMV hierarchy, composed of E^MV and H^MV for k G N®' [T3], we 
inductively define = GFLMV, n^F^MV = co-E^flmv, and E^flivIV = GFLMVT(nCFL) for 

every index k > 1. In a similar fashion, we define E^FLgy GFLSV^ in place of GFLMV^. The above 
CFLMV hierarchy is useful to scaling the computational complexity of given functions. For example, the 
function f{w) = {x G {0,1}* | 3u, v[w = uxxv]} for every w G {0,1}* belongs to E 2 ^F]\/[y^ Moreover, it is 
possible to show that GFLMV U co-GFLMV C GFLMV 0 GFLMV C EJflmv. 

Proposition 4-3 Each function in IJfeeN+ S^FLgy^ computed by an appropriate 0(n) space-bounded 

multi-tape deterministic Turing machine. 

Proof Sketch. It is known in [^ that E^fl g DSPAGE(0(n)) for every A: > 1. It therefore suffices 
to show that, for any fixed language A G DSPAGE(0(n)), every function / in GELSVt"^ can be computed 
using 0(n) space. This is done by a direct simulation of / on a multi-tape Turing machine. □ 

For fc > 3, it is possible to give the exact characterization of REG//E^FLgy^_ This makes a sharp 
contrast with Proposition 13.61 31. 

Proposition 4-4 For every index k>3, E^fl q H^fl = REG//ECFLgy^. 

Proof Sketch. By extending the proof of Proposition 13.61 31. it is possible to show that E^fl p H^fl g 
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REG//I]®^^SVt. Similarly to Proposition l3.6r 2l. it holds that REG//E^^^SVt is closed under complement. 
It thus suffices to show that REG//E^^^SVt C E^^^. This can be done by a direct simulation. □ 


Lemma 4.5 Let e > 2 and k>l. E^^Lsy = E^^Lsv => E^fl = gCFL ^ sCFLgv = ECFLsv. 

Proof Sketch. Assuming E^^Lgy ^ let us take any language A G E^^^ and consider rjA- It is 

not difficult to show that, for any index d G N+, A G E^fl jg-g E^FLgy^ Thus, r]A G E^FLgy _ S^FLgy^ 
This implies that A G E^fl^ Next, assume that E^fl „ E^f^. It is proven in [3T] that E^fl „ E^f^ 
iff E^fl _ e^ff for all e > 1. Hence, for every e > 2, we obtain E^fl _ E®ff_^, which is equivalent to 
nCFL = It then follows that E^F^gy = GFLSVT(nCFL_^) = GFLSVT(nCFL) = ECFLgy, □ 

Regarding refinement, from the proof of [SJ Theorem 3] follows NFAMV Ere/ NFASV. This result leads 
to NFAMV o GFLSV Ere/ GFLSV in m- By a direct simulation, nevertheless, it is possible to show 
that E^FL]y[y E^flSV for every A: > 1. Lemma [4.51 together with this fact leads to the following 

consequence. 

Proposition 4-6 Let k>2. //ECfl = eCfl^ then E^f^mV Ere/ S^|Fgy^ 

Recently, it was shown in that GFLMV Ere/ GFLSV holds. However, it is not known if this can be 
extended to every level of the GFLMV hierarchy. 

5 Optimization Functions 

An optimization problem is to find an optimal feasible solution that satisfy a given condition. Krentel m 
studied the complexity of those optimization problems. Analogously to OptP of Krentel, we define OptGFL 
as a collection of single-valued total functions / : E* —> P* such that there exists an npda M and an 
opt G {maximum,minimum} for which, for every string a; G E*, f{x) denotes the opt output string of M 
on input x along an appropriate accepting computation path, assuming that M must have at least one 
accepting computation path. Here, we use the dictionary (or alphabetical) order < over P* (e.g., abbe < abc 
and ab < aba) instead of the lexicographic order to compensate the npda’s limited ability of comparing 
two strings from left to right. For example, the function f(w) = max{PAL;,„b(n))} for w G {0,1}*, where 
PAL sub is defined in Section [I] is a member of OptGFL. It holds that GFLMVt Ere/ OptGFL. 

Proposition 5.1 CFLSVt ^ OptGFL C EjF^SVt. 

The first part of Proposition 15.II comes from a fact that the function f{w) = max{ 5 (rt;)}, where g{w) = 
{A} U {xiPi I w = xi\\X 2 p: 3 ffyi\\y 2 ^y 3 TXi = yf^,i G {1,2,3}}, is in OptGFL but not in GFLSV*. This latter 
part is proven by applying the functional pumping lemma. 

Note that, in the polynomial-time setting, a much sharper upper-bound of OptP C E^SV* is known. 
Similarly to OptGFL, let us define OptNFA^^ using nfa’s M instead of npda’s with an extra condition that 
M(x) outputs only strings of the equal length. This new class is located within E^FLgy^_ 

Proposition 5.2 OptNFA^^ C E^FLgy^ 

Proof Sketch. Let / G OptNFA^^ and take an underlying nfa N that forces f{x) to equal max{V(a;)} 
for every x. Define an oracle npda Mi to simulate N on x and output, say, y. Simultaneously, query yffx^ 
using a stack wisely. If its oracle answer is I, enter an accepting state; otherwise, reject. Make another npda 
M 2 receive y(fx^, simulate on x^, and compare its outcome with y^, where the notation refers to 
an nfa that reverses the computation of V. □ 

Proposition 5.3 1. GFL U co-CFL C RFG//OptCFL C EJFl q hJfl. 

GFL//OptCFL C E^FL, 

Proof Sketch. We will show only (I). Note that RFG//OptGFL is closed under complementation. 
Let L G CFL and take an npda M recognizing L. Define Ni as follows. On input x, guess a bit b. If 

6 = 0, then output 0 in an accepting state. Otherwise, simulate M on x and output 1 along only accepting 
computation paths of M. Let h{x) be max{Vi(a:)} for all a;’s. It follows that L = {[h(x)\ \ h{x) E 0}. 
This proves that L G REG//OptGFL. Next, let L G REG//OptCFL. Since OptGFL C EjF^SVt, we obtain 
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L G REG//EjFLSVt. By Proposition SJ this implies that L belongs to 


□ 
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